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MODELLING OF GROUP EXPERT JUDGMENTS UNDER CONDITIONS OF COMPLEX 
UNCERTAINTY 


Abstract: For decision making under uncertainty multicriteria decision methods are used to rank the alterna- 
tives based on the preferences expressed by experts. Decisions are often made on the basis of imprecise, uncertain 
and/or incomplete information provided by several sources, some of which may be unreliable. The paper offers 
implementation examples of the theory of plausible and paradoxical reasoning and the PCRS rule for decisions 
making under conditions of complex uncertainties that are generated by arbitrary (contradictory) expert evidence. 
The mathematical models under consideration prevent errors and provide the greatest accuracy in processing the 
results of an expertise under conditions of multicriteria, multi-alternatives and complex uncertainties. The appli- 
cation of the classic combination rule and the PCRS rule is used to deal with conflicting expert judgments of the 
Dezert-Smarandache model and the Dempster-Shafer model respectively. 

Key words: DSmT, DST, frame of discernment, fusion, PCRS, uncertainty. 


Problem statement. Effective results of group ex- 
pert assessments analysis can be obtained with the suit- 
able approach to pairwise comparison. The choosing of 
such an approach requires taking into account different 
forms of ignorance, i.e. situations where the necessary 
information is either missing or inadequate or presented 
in an inappropriate form. There are three common 
forms of ignorance: incompleteness — situations in 
which some data is unknown, but all available infor- 
mation is complete and correct; inaccuracy — a situa- 
tion in which the reliability of data is certain, but the 
data itself is inaccurate; uncertainty — situations in 
which all available data is either true or false which can 
be estimated using probabilistic estimates. 

In practice, different forms of ignorance, for in- 
stance, a combination of inaccuracy and uncertainty, 
occur rather often. Let's consider a situation where for 
a certain expertise the methods for obtaining and/or an- 
alyzing expert information were chosen unreasonably. 
This factor generates the inaccuracy of the received 
data. Also in the process of analyzing expert judgments 
the information about the experts’ competence was not 
considered (or was not provided). This factor generates 
the uncertainty about the received data. 

Itis also necessary to take into account the fact that 
the obtained expert judgments (evidence) can interact 
with each other in different ways. Such pieces of evi- 


dence can be consistent 
( Q1 (105 CY... (00, = @ ), consonant 
( 0 С 05 C ...C O0, ), arbitrary 


( © NAY (C... Y; Г... 00, =, АС: 
0; (10; #O) or disjoint (0j NO; = Ø). 


Therefore, an application of new theories and ap- 
proaches for the analysis of such expert judgments is 
needed [10, p.43; 11, p.37; 13, p.24]. 

Review. Various methods of group expert evalua- 
tion are widely used in the process of alternatives selec- 
tion in conditions of weakly structured or unstructured 
problems. Consequently, the task of obtaining general- 
ized expert assessments may be the basis for formation 
of the recommendations for the decision maker. In this 
case, the main problem is the processing of conflicts, 
which refers to situations where focal elements (se- 
lected subsets or groups of expert evidence) do not in- 
tersect. 

The main cause of conflicts between basic belief 
assignments is the inconsistency of individual groups 
of expert evidence. Unfortunately, the fusion rules 
based on conjunction consensus do not take into ac- 
count the degree of intersection of the initial focal ele- 
ments [12, p.170]. 

In this paper three theories are considered, that are 
dedicated to the modelling of complex uncertainties, 
characterized by the union and intersection as forms of 
experts’ judgments interaction. They are as follows: 
Dempster-Shafer theory of evidence [1, p.150; 3, p.13; 
7, p.3], Dezert-Smarandache theory of plausible and 
paradoxical reasoning [2, p.15; 5, p.11], conflict redis- 
tribution theory [6, p.24; 8, p.230]. 


Lm 
[NN 
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The paper [8, p.207] provides information on how 
a number of combination methods handle conflicts. 
That can be summarized as follows: 

- the Dempster fusion rule generally ignores the 
conflict and attributes any probability mass associated 
with conflict to the null set. The conflicting masses are 
used in the normalization process of the resulting 
masses; 

- the Dezert-Smarandache classic fusion rule 
simply determines the combined probability masses for 
all possible sets of the initial focal elements, ignoring 
the nature of these intersections; 

- inthe DSm hybrid fusion rule, the transfer of 
partial conflicts (taking into account all integrity con- 
straints of the model) is done directly onto the most spe- 
cific sets including the partial conflicts but without pro- 
portional redistribution. 

The rules of combination that are commonly used 
in the frameworks of DST and DSmT are as follows: 
the general Weighted Operator (WO), the Weighted 
Average Operator (МАО), minC rule, PCR1-PCR5 
rules etc. 

The basic idea of these rules is to redistribute total 
conflicting mass among the non-empty intersections of 
the initial focal elements. The main steps in applying 
all the rules of combination are as follows [6, p.2]: 


- use the conjunctive rule to compute masses of 
non-empty sets of initial focal elements’ intersections; 

- compute the conflicting masses (partial and/or 
total); 

- redistribute the conflicting masses to non-empty 
sets. This process differs for each of the PCR1-PCR5 
rules. 

The aim of the research is to consider the possi- 
bility of applying the theory of plausible and paradoxi- 
cal reasoning and the theory of evidence for decision 
making under conditions of complex uncertainties that 
are generated by contradictory expert judgments. 


Basic material апа examples. Let 


Q= lo; FE ln] be a finite discrete set of ex- 
haustive and exclusive elements (hypotheses) called el- 
ementary elements in DST. О. has been called the 
frame of discernment of hypotheses or universe of dis- 


course. An expert may select subsets X j с О, 


‘ Q Q 
f= 1,2! | including the empty set O , where 2 


? т Q 
is a cardinality of the power set. Any element of 2 

is a composite event (disjunction) of the frame of dis- 
cernment that satisfies the following requirements: 


- X j == (©; } — an expert selected only one alternative 0); € О; 


- Xj = {@, li= 1, р}, р < П -an expert selected p alternatives 0), € О; (1) 


- X; =О = {@, [Т = 1, n} — all alternatives are equivalent. 


In real-life situations it is not always possible to 
correctly identify (distinguish) all or some elements of 
the frame of discernment (the condition of alternatives 
being mutually exclusive is not supported), in which 
case they can largely overlap one another. This is pos- 
sible in a situation where the elements of the frame of 
discernment represent vague uncertain concepts, for in- 
stance, color palette, etc. 

A new broader theory was needed to analyze such 
situations under conditions of uncertainty. Such a the- 
ory, created at the beginning of the 21st century, was 
called the theory of plausible and paradoxical reasoning 
(Dezert-Smarandache Theory – DSmT). In the DSmT 


framework, a frame (25 (o; li- ln) consists 


of a finite set of exhaustive hypotheses, which can po- 
tentially intersect. In the frame an expert can select sub- 


sts X; c DP i -L|Dp? 


following requirements: 











, which satisfy the 


The above mentioned requirements (1); 

Q 

= If (X;,X ;) CD", 
(X; ^ X ) e D and (X; UX ;) e D®. 


Therefore, the results of an expert evaluation are 
used to fom a system of | subsets 


then 


Х = {Р J =1,m}, which displays all experts’ 


judgments he (Ej j = 1, т} Р where 


Р; == X; i= 1, р} — is a system of subsets, se- 


lected by a certain 


E;(p -|D? —1,Х, c DÊ). 


DSmT is based on so-called free DSm model. The 


exclusivity assumption between elements of Q is not 
necessary within DSmT. However, in DSmT any integ- 


expert 





rity constraints between elements of Q can also be in- 
troduced, if necessary, depending on the fusion prob- 
lem under consideration. A free DSm model including 
some integrity constraints is called a hybrid DSm 
model. DSmT can deal also with the Shafer’s model as 
well which appears actually only as a specific hybrid 
DSm model. The free model is formed on a set of all 


Q 
possible subsets of hyper-power set D. 
For example, а frame of 


Q={0, 0,03} has |p? 


discernment 


=19 possible 





subsets. Therefore, subsets Х; c O,i = 0,18 can 
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be formed based on one group of expert judgments. Ex- The main disadvantage of the free model is that 
perts assign bbas m,(Xi) to every Xi, which are com- 
bined using the DSm rule [5, p.16]: 





even with <4 elements of the frame of discern- 
ment, the calculations are very complicated. However, 


real-world tasks are characterized by much smaller 

Mps (X ) EE 2. т; (X i ). number of alternatives than the number of all possible 
Are ЕО: gel Q 

X,Q.nX,-X subsets D". Hence, the authors of the theory pro- 


posed a hybrid model, which is formed on the assump- 


| . tion of introducing restrictions on various elements of 
between bbas for § 22 independent sources of evi- е free model. 


dence. 
There are three basic functions in DST and DSmT: 


- the basic belief assignment (bba) №: A [051] : 


0<т(Х,)<1, W(X; €A), m(2)-0, Ут ЕЕ 
X,EA 


This rule is also known as conjunctive consensus 


- the belief function Bel : A > [051] : 
Be(B)- Ут(Х,); 


X;cB,X;e^ 
- the plausibility function PL: A > [0;1]: 
PI(B) = Lm X;), 
X, B2, X,eA 


Q Q 
where A isa power set which equals 2°“ for DST and 0° for DSmT. 


The value of m( X i) expresses the proportion of all relevant and available evidence that supports the claim 
that a particular element of О belongs to the set X ic О. but to no particular subset of X;. The value of 


m( X i) pertains only to the set X; and makes no additional claims about any subsets of X;. 


Bel(B) summarizes all our reasons to believe in B (i.e. the lower probability to believe in B).The plausibility 
PIB) of B measures the total belief mass that can move into B (interpreted sometimes as the upper probability of 
B). Since Bel(B) summarizes all our reasons to believe in B and РКВ) expresses how much we should believe in 
B if all currently unknown were to support B, the true belief in B is somewhere in the following interval: 


[Bel(B), РКВ)] c [0,1]. 


Thus, the above mentioned models that illustrate the various forms of group expert judgments can be sources 
of specific uncertainties. Therefore, the traditional probability theory cannot be used for their modelling. 

The PCR rules redistribute partial conflicting masses differently. The PCR combination rules work for any 
degree of conflict, for any DSm models (Shafer's model, free DSm model or any hybrid DSm model). The sophis- 
tication, complexity and also correctness of proportional conflict redistribution increases from the first РСКІ rule 
up to the last rule PCRS [6, p.12]. 


Let's ©) be the frame of the fusion problem under consideration with two focal elements X; and X», and 
belief assignments: mi(Xi) mo(Xi), mi(X2), m2(X2). The focal elements are involved in a conflict, i.e. 


X, ПХ, = Ø. The conjunctive consensus is calculated as follows: 
1 2 J 
m(X, OX2)=m(X,)*m(X2)+m (Ху) * m (X2). 

The PCRS rule is based on the redistribution of the partial conflicting mass proportionally on non-empty sets 
involved in the conflict: m(X, (YX5) х= т (Ху) * m5 (X2), у= m»j(X) * mi (X2). The 
conflicting mass x is redistributed to X; and X» proportionally with the masses mı(Xı) and m2(X2) assigned to Xi 
and X» respectively, the conflicting mass у is redistributed proportionally with the masses m2(X1) and mı(X2) as- 


signed to X; and X respectively. 
For the fusion of s=2 sources the PCRS is defined by [8, p.264]: 


m(Xı)*m (X2) n m,(X,)*m(X>) 
m((X,)--m;j(X3) my(X,)*m(QX5) { 


where m(X1) is a combined conflict mass of Xi, calculated on the basis of conjunctive consensus. 
Example 1. To illustrate DSmT, let us consider a brief example. There is a frame of discernment 


Q= {© 305 } and a free DSm model: 
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Xo =Ø, X =, X =03, Хз =O, 005, X4 =O, UM) 
with associated bbas: 
т (0) = 0,45; т (05) == 0,3; m (0 C W> ) = 0,1; т (0 U ©») = 0,1 5; 
nm» (0) = 0,1 5; m (©) = 0,35; nm», (0 (105) = 0,4; My (0 U Q5) = 0,1; 


m4(0,) = 0,25; m (65) 20,22; m4(0, 065) = 0,2; m4(0, 05) = 0,35. 
These masses are to be combined using the Dezert-Smarandache rule. All the combined subsets of the focal 
elements' intersections are presented in the table 1. 




































































Table 1. 
Non-empty sets of the three sources example 
C5 0 Q5 © ^» © UO 
CiC? 
Го) A} 0] © (15 Го) AW) © 
= (^5 = (^5 © AW Го) A @ UO? 
© AQ, (105 © (^5 © (15 © ^» © UO 
€ CY (64 UO?) Q1 (| 05 Q1 05 Oy 
622 (10 Го) AW) © (15 © AW © UO 
602 NW © (^5 > a AW оэ 
Q5 NA (^5 © (^5 © AW? © (^5 @ 0» 
€» N UW?) Q1 05 05 09] UO) 0» 
© (15 NANA Го) ^» © (1 © AB) @ UO 
© (^05 (^5 © AW © (15 QA @ UO? 
© (^5 (^ (^5 © (^5 © (1 QA @ UO 
QM (^ €» CY(64 7 0») Q1 05 (0| 05 0] 05 O UO? 
(64 205) AQ, Q © (105 © UM) о 
(о 705) e Q1 (^5 0» 0] 05 0» 
(64 022) 6 (00) Q9 UM) © UM) © UO) © UM) 
(оу UM) (оу 05) Q 0) © UW © UW 








The calculated generalized bbas of expert evidence are as follows: 


Mpg (6) = m, (оу) * m» (0, ) * ms (69) + m (ооу) * m (6) * m (0, U 5) + m (оу) * 
* m, (01 U 05) * m4(0,) + m (ву) * m (00у UM) * ть (00 U о») + +m (оу 05) * 
* m, (01) * m (0) +m (0, UM) * m (9) * m (00у 05) + mj (o, 95) * 
* m, (00 U 05) * m4(0,) = 0,085; 
mpg (Oz) = m (5) * m (095) * m (05) + ти (Mz) * m» (05) * m (у V 005) + 
+ mj (0^) * ть (оу U 05) * m (65 ) + m (05) * m (юу 005) * m (0 0») + 
+ m (à, U 05) * m, (605) * m (005) + m (0; U 05) * m, (05) * m (@, UM) + 
+ m (0, U 05) * m (@, U 05) * m (65 ) = 0,106; 
Mps (0, (05) = 0,477; 
тру (6, UW, ) = 0,332. 


The calculated results indicate that the best alternative is intersection of ће elements 0); and (9^ with the 
bba that equals 0,477. 

Example 2. For the next example let us consider the frame of discernment О = {оу , 005, 004 }, Shafer’s 
model, and the 3 following bbas: 


Lm 
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mj(6,)— 0,15; ту(0,) = 0,55 ту (3) = 0,3; 
n (0) = 0,45; т» (65 ) = 0,35; т» (03) = 0,2; 


Fusion of ће non-empty sets bbas of the initial focal elements yields: 


тоу) = m (0) * ть (о) * m (оу) = 0,15 * 0,45 *0,25 = 0,017, 
m(Q») = m (95) * My (>) * m (0) = 0,55 * 0,35 * 0,4 = 0,077, 
т(оз) = m (3) * ть (03) * ть (@3) = 0,3* 0,2 * 0,35 = 0,021 
with conflicting mass К = 0,885, therefore PCRS rule is to be used. 
The conflicting masses are: 
MO, VO, (105) = m (6, ) * m (6 )* m (05) = 0,027; 
MO, VO, V3) = m (0 )* m» (юу) * m (04) = 0,024; 
MO, VM (04) = m (6, )* m (605) * m (о) = 0,013; 
MO, VM VM) = m (0) * m (005 ) * m (œ, ) = 0,021; 
MO, VO (104) = m (0) ) * m (05) * m (003 ) = 0,01838 
mO С\ ©з 004) = m (6, )* m (003 ) * m (œ ) = 0,0075; 
MO, V3 VWs) = m (04) * m (04) * m (00) = 0,012; 
m(Q, N0 (103) = m (00) * m (003 ) * m (003 ) = 0,0105; 
m(Q» (0, (04) = m (95) * m (6, )* m (о) = 0,062; 
m(Q» VO, (05) = m (95) * m (0, ) * m (05) = 0,099; 
m(Q» VW, (04) = m (05) * m (0) * тз (0з) = 0,0866; 
m(Q» N0 (0) = m (00 ) * m (05) * m, (ор) = 0,048; 
т(65 (7009 (103) = m (05) * m (05) * m (@3) = 0,0674; 
m(Q» 103 004) = m (95) * m (094) * m (0, ) = 0,0275; 
m(Q» N0 (005) = m (©) * m (04) * m (00, ) = 0,044; 
m(Q» N ©з (095) = m (95) * m (04) * m (M3) = 0,0385; 
m(Q 1M, N0) = m (093 ) * m (оу) * ть (оу) = 0,003375 
m(Q4 1M, VW) = m (05) * m (оу) * ть (05) = 0,054; 
m(Q4 С\ юу (104) = mj (05) * m (6) * m (003 ) = 0,04725, 
M(O3 (7 009 (104) = m (04) * m, (05) * m; (œ ) = 0,02625, 
т(оз N 05 (05) = m (003 ) * m (025) * m; (0025) = 0,042; 
m(G4 N 0 (105) = m (65) * m, (05) * ть (094) = 0,03675; 
т(оз 103 N) = m (094) * m (05) * m, (œ ) = 0,015; 
(3 (104 (105) = m (04) * m, (05) * m; (65) = 0,024. 
The first local conflict (00р (164 (105) = = m (0) * m (64) * m (65 ) 
= 0,15 * 0,45 * 0,4 = 0,027 is proportionally redistributed between alternatives @, and (05: 


LN 
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x, Xi 


0,15*0,45*0,4 





015*045 04 


Thus, x; = 0,0039; y, 20,0231. 


The second local conflict 


0,15*0,45 + 0,4 


MQ, Na V3) = = m (9) * m; (6) * m (0з) 


= 0,15 T 0,45 * 0,35 = 0,024 is proportionally redistributed between alternatives О?у and 003 : 


X3 < _ 


0,15*0,45* 0,35 








015*045 035 


Thus, хо = 0,00382 г = 0,0198]. 


The local conflict 


0,15*0,45 + 0,35. 


m(a, VWs N) == m (o) * m, (95) * m (63) = 


0,1 5* 0,35 e 0,35 = 0,0 184 is proportionally redistributed between alternatives (04 , (05 and (4: 


Xs У4 


<2 _ 


0,15 * 0,35 *0,35 





015 0,35 035 015+0,35+0,35. 
Thus, X5 = 0,00324 у, =0,00757, 2, =0,00757. 
Adding all corresponding masses, one gets the final result for 00у, (05 and (05: 
Mpcps(O,) = т(ор) + x, +... + хз = 0,01688+ 0,0039+ 0,00382+ 0,00127+ 


+ 0,01086+ 0,00324-- 0,00118+ 0,0024- 0,007 16+ 0,0105 1+ 0,06649+ 
+ 0,02888- 0,02719+ 0,00688+ 0,0092 + 0,021 13+ 0,0383 1+ 0,007294 


+ 0,0121= 0,27868 


pcs (03) = m(@3) + Z +... + zig =0,021+0,01981+ 0,00757+ 0,00632+ 
+ 0,0032 0,00334+ 0,02246+ 0,04347+0,0055+ 0,02095+ 0,00435+ 
4-0,02455-- 0,01409- 0,00894+ 0,00875-- 0,02864+ 0,00848+ 0,0029+ 


+ 0,003 13=0,25743. 


тьскз (905) = т(®») + y +...+ Ув = 0,077 + 0,023 14 0,01 185+0,01014+ 
+ 0,00757+ 0,0064+ 0,05137+0,03251+ 0,03529+ 0,02094-- 0,0239 1+ 
+0,01513+0,02305+ 0,03415+ 0,01878+0,01021- 0,01336+0,02827+ 


+ 0,02087 = 0,46389, 


In this example, the initial level of experts’ support regarding subset (04 on the frame of discernment 


AmO ) = 0,017 mœ) = 0,077 т(0з ) = 0,02 D after the redistribution of conflict became 


even more pronounced. 

Conclusion. This paper offers two examples of 
combination rules implementation. The differences be- 
tween DSm and РСВ5 rules lie in how they process the 
conflicting mass of empty sets. The classic DSm rule 
allocates these masses to the intersection of the corre- 
sponding focal elements. If the initial focal elements do 
not intersect, then the combined mass is allocated to 
both focal elements without any other assumptions. The 
general principle of the PCRS rule is to redistribute the 
conflicting mass proportionally on non-empty sets in- 
volved in the model according to all integrity con- 
straints. Thus, the РСВ5 rule does the most accurate re- 
distribution of partial conflict masses. It should also be 


noted that both the DSm and the PCRS rules are hard to 
implement because they require a large amount of com- 
putation, especially in cases with more than two groups 
of evidence. However, the appropriate software makes 
such a disadvantage less significant. Perspective for 
further research is to consider presenting the task of 
searching and selecting multicriteria alternatives as the 
task of choosing the optimal organizational structures 
of complex organizational systems of large enterprises. 


10 Wschodnioeuropejskie Czasopismo Naukowe (East European Scientific Journal) #5(45), 2019 





References 

1. Beynon, M.J. DS/AHP method; a mathemati- 
cal analysis, including an understanding of uncertainty 
[Text] / M.J. Beynon // European Journal of Opera- 
tional Research, 2002. — vol.140. — pp. 148-164. 

2. Dezert, J. Foundations for a new theory of 
plausible and paradoxical reasoning [Text] / J. Dezert // 
Information and Security Journal, Semerdjiev Ed., 
Bulg. Acad. Of Sc., Vol. 9, 2002. 

3. Sentz, K. Combination of evidence in Demp- 
ster-Shafer Theory [Virtual Resource] / Karl Sentz, 
Scott Ferson // Sandia National Laboratories, 2002. — 
96 p. — Access Mode: prod.sandia.gov/techlib/access- 
control.cgi/2002/ 020835.pdf. — Date of Access: 
29.02.2016. 

4. Shafer, G. A mathematical theory of evidence 
[Text] / G. Shafer. — Princeton University Press, 1976. 
— 297 p. 

5. Smarandache, F. Advances and applications 
of DSmT for information fusion [Text] / F. 
Smarandache, J. Dezert // Rehoboth: American Re- 
search Press. — 2006. — vol.2. — 461 pp. 

6. Smarandache, F. Proportional conflict redistri- 
bution rules for information fusion [Text] / Florentin 
Smarandache, Jean Dezert //American Research Press, 
2006. — vol.2. — 41 p. 

7. Smets, Ph. Analyzing the combination of con- 
flicting belief functions [Virtual Resource] / Philippe 
Smets // Universite’ Libre de Bruxelles, 2005. — 39 pp. 


— Access Mode: 
iridia.ulb.ac.be/-psmets/Combi Confl.pdf. — Date of 
Access: 29.02.2016. 

8. Uzga-Rebrovs, O. Nenoteiktiby parvaldisana / 
O. Uzga-Rebrovs. — Resekne: RA Izdevnieciba, 2010. 
— vol.3 — 560 pp. 

9. Zhang, L. Advances in the Dempster-Shafer 
theory of evidence [Text] / Lianwen Zhang // New 
York: John Wiley & Sons, Inc, 1994. — P. 51-69. 

10. Валькман Ю.Р. Моделирование HE- 
факторов — основа интеллектуализации компьютер- 
ных технологий / Ю.Р. Валькман, В.С. Быков, 
А.Ю. Рыхальский // Систем. дослідж. та інформ. 
технології. — 2007. — № 1. — С. 39-61. 

11. Душкин, Р.В. Об одном подходе к автома- 
тизированному извлечению, представлению и об- 
работке знаний с НЕ-факторами/ Р.В. Душкин, 
Г.В. Рыбина // Известия РАН Теория и системы 
управления. — 1999. — №5. — С. 34-44. 

12. Коваленко, И.И. Методы качественного 
анализа в задачах судостроения, судоремонта и су- 
доходства: учебное пособие [Текст] / И.И. Кова- 
ленко, Т.В. Пономаренко, А.В. Швед и др. — Нико- 
лаев: Илион, 2014. — 220 с. 

13. Коваленко, И.И. Некоторые НЕ-факторы и 
методы их моделирования / И.И. Коваленко, А.В. 
Швед // Вісник ХНТУ. — Херсон, 2013. — №1(46). 
— C.23-27. 





